Zero- Temperature Limit of the SUSY-breaking Complexity 
in Diluted Spin-Glass Models 
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We study the SUSY-breaking complexity of the Bethe Lattice Spin-Glass in the zero temperature 
limit. We consider both the Gaussian and the bimodal distribution of the coupling constants. For 
Jij — ±1 the SUSY breaking theory yields fields distributions that concentrate on integer values at 
low temperatures, at variance with the unbroken SUSY theory. This concentration takes place both 
in the quenched as well as in the simpler annealed formulation. 



The complexity, i.e. the logarithm of the number of 
metastable states, is a crucial tool to understand spin- 
glasses and related disordered systems Recently it 
become clear that in mean-field models there are two pos- 
sibilities: a supersymmetric (SUSY) theory and a sponta- 
neously SUSY-broken theory. The behavior of the 
complexity of the states with free energy /, in one-step 
replica-symmetry-breaking (IRSB) models is the follow- 
ing : at low free energies (including the equilibrium one) 
the theory is supersymmetric (SUSY) while at higher free 
energies the SUSY-breaking theory must be used . 
In models with fuU-RSB (FRSB) like the Sherrington- 
Kirkpatrick model the SUSY solution is unstable imme- 
diately above the equilibrium free energy f^q P| and the 
complexity must be computed using a SUSY-breaking 
approach at all / > f^q. The paradigm of the SUSY- 
breaking solution is the Bray and Moore computation of 
the SK model that in the replica formulation corresponds 
to the two-group ansatz 0]. Some apparent inconsisten- 
cies of this theory Q have been solved by the discov- 
ery of a vanishing isolated eigenvalue |^ in the spectrum 
of the TAP Hessian and in t| it has been proved that 
this result is a consequence of SUSY breaking and there- 
fore is very general. Later these results have also re- 
ceived some numerical confirmations Thus the rele- 
vant states are marginal within the SUSY-breaking the- 
ory but there are also non-marginal states with a lower 
total complexity The theory of diluted spin-glass 
models and optimization problems has received a con- 
siderable boost by the application of the cavity method 
[lOl . The standard com put ation scheme of the com- 
plexity used in this context [13 corresponds to the SUSY 
theory and becomes unstable in certain regions of the pa- 
rameter space [l^. Much as in mean-field models with 
infinite connectivity, this instability could be caused ei- 
ther by a IRSB/FRSB transition or by a less standard 
SUSY/ SUSY-breaking transition. This has motivated 
the search for a formulation of the SUSY-breaking the- 
ory within the cavity method which has been achieved in 
0, see also 0. If we add a small perturbation to the 
weight of the states 0, we select a set of non- marginal 
states slightly different from the relevant ones, and the 
cavity method can be applied. The relevant states are 



recovered sending to zero the perturbation; this limit is 
non-trivial, indeed as the perturbation goes to zero the 
reweighing associated to its presence remains finite be- 
cause of marginality. Later this method has been used 
to derive the SUSY breaking theory for diluted models 
|l6j |. Here we study the zero temperature limit of this 
theory which is particularly interesting for the applica- 
tion to optimization models. Particularly in the case of 
bimodal distribution of the coupling constants this limit 
is rather non-trivial, and our main result is that the field 
distributions concentrate over integer values. Remark- 
ably this happens already within the so-called factorized 
approximation, a result not totally unexpected because it 
has been recognized that it corresponds to the annealed 
solution. 

The Complexity at Finite Temperature - In the follow- 
ing we recall the theory at finite temperature 'l6l|. One 
finds the recursive equations for the fields h and z in the 
Bethe lattice spin-glass are: 



ho = y^^u{Ji,hi) 



E 



dujJj, hj) 
dhi 



(1) 



where m(J, h) = P ^arctanh[tanh(/3J) tanh(/3/i)]. 

The complexity is the number of the solutions of these 
equations. The fields Zi are zero in the standard SUSY 
solution, they are non-zero only if the solutions are 
marginally stable (it can be argued that they are pro- 
portional to the components of the eigenvector of the 
vanishing isolated eigenvalue). 

The recursive equation for the distribution of the fields 
/iQ and zq is 



Po(/»o,2o) = C 



X(5 ho - ^m(Jj, hi 



du{Ji, hi) 
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where: 



In [2 cosh Pho] + ^ In 



cosh/3Ji 



cosh Pu{Ji, hi) 



(3) 



[tanh /3/io — tanh /? tanh phi] '^^i 
j=i ' 



(4) 

The shifts in the process of merging k + 1 hnes, AF*^^^ 
and AX(i\ arc the same as above with k replaced by 
fc + 1. The distribution of distributions V[P{h,z)] can 
be determined numerically by population dynamics [lol |: 
as usual in the factorized approximation the population 
Pi(hi,Zi) is site independent and corresponds to the an- 
nealed theory 0. The functional = !](/) - m/3/ 
is the Legendre transform of the complexity; its shift is 
given by: 



A$(u) hi f l[P,{h,,z,)dh,dz, 

(5) 

The Legendre transform with respect to u of the com- 
plexity is given by 



1 



2 

k - 1 



Y[riP,ih,,z,)){A^uf"'-^)j 

1=1 
fc+i 

l[V{Pdh^,z,)){A^uY^^)j (6) 



Using this expression we can evaluate the distributions 
of the fields at zero temperature through population dy- 
namics. In general the resulting distributions of the fields 
have the following properties: i) there is a finite proba- 
bility of having a strictly zero value of z, ii) the non-zero 
values of z are rather large and diverging with the con- 
nectivity, iii) there is a strong correlation between Zi and 
hi such that sigTi(hiZi) has a very small probability of 
being negative. 

Bimodal Distribution (Jij = ±1). In this case the fields 
concentrate over the integers in the T ^ limit but we 
must keep track of the behavior of the finite-temperature 
corrections to the integer value. We rewrite the field hi as 
the sum of an integer contribution ki and an infinitesimal 
contribution Te^: h, ^ h + Te, + 0{T'^). The fields 
remain finite in the T ^ limit. We must consider 
populations of triplets {fci,ei,Zi} obeying the following 
recursion equations: 



ko = J,sign(fci) 



i=l 

fe 



eo = ^sign{Ji)g{ki,ei) 



i=l 

fe 



zo 



Edu \ - 



du 



dh. 



sign(Ji)zi 



(11) 
(12) 

(13) 



where the function g{ki,£i) can be obtained taking the 
limit of the expression oi u{Ji,hi) and is given by: 



where the square brackets mean average over the bonds 
Ji, and A^*^^) has the same expression A$(**'^''^ with fc+1 
indexes instead of fc. At u = eq. © gives the total 
complexity. The free energy is given by j3f — d^/du. 
This derivative can be computed numerically or more 
efficiently by deriving with respect to u the variational 
expression of $(u), eq. 35 in [iq . 

The Zero -Temperature Limit - Gaussian Distribution 
of the Jij - In the T ^ limit we have to modify the func- 
tions u{hi, Ji) and du/dh entering the recursion equations 
for the fields, 



liva u{J,h) = signJi 



du 
T-+0 dh 



sign Jj 



hi if \hi 
\Ji\sig\ihi if \hi 

1 if M < \J^\ 
if \h,\ > |J,| 



> \J^\ 



(7) 

(8) 



The limit of the shifts are obtained simply replacing the 
functions tanh (3hi with sign hi in the expressions (jS)) and 
thus we obtain 



-AF(i) = \ha\ 



fe+i 

^(1 Jil - \u{Ji, hi)\ 
1=1 



fe+i 

AX^^) = [sign/io - sign( Ji/ii)] —Zi 



j=i 



dhi 



(9) 
(10) 



du 



e 

sign(fci) 



for ki — 
In 2 cosh e, for \ki\ ^ I (14) 
for A;,- > 1 



dhi 



1 

sign(fci 



1 

2 2 
p-2/3(|h.| 



- tanh 6; 
^ 



for 
for 
for 



\h\ = 1 
M > 1 



(15) 



The ei's have a precise meaning at zero temperature: if 
the spin is a spin-fous, i. e. ko = the quantity tanh ep 
is its magnetization averaged over the many configura- 
tions of the same energy that represent the zero temper- 
ature state. At low temperatures the behavior of the z 
fields is dramatically different depending on the parity of 
k. If k is even, the z fields remains finite in the T 
limit (they would diverge in the high-connectivity limit). 
Instead if k is odd, the z-fields diverge as exp(2/3| J|) and 
must be rescaled at zero temperature. 

Even Values ofk- In this case the z-fields remain finite. 
In order to compute the reweighing term eq. 10} in the 
zero temperature limit for k even it is sufficient to take 
the limit of tanh(f3hi) which reads: 



lim tanhphi — 



signfci for ki ^ 
tanhe.; for h = 



(16) 



3 



The free energy shift reads 

k+l 

- AF(i) = Ifcol + ^(1 J.I - |signfc,|) . (17) 



We have determined the distribution of the fields by 
evolving numerically populations of triplets {ki, e^, Zi} at 
u = 0. For generic even values of k the resulting distri- 
bution of the fields is such that: i) the z's have a finite 
probability of being exactly zero, ii) The non-zero values 
of z are rather large and diverging with the connectiv- 
ity k, iii) there is a strong correlation between Zi and hi 
such that sign(/iiZi) has a very small probability of being 
negative, iiii) the entropic corrections are rather large, 
(see fig. P). 
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FIG. 1: T — > limit annealed theory for Bimodal Dis- 
tribution, k—2. Left: cumulative distribution function of 
sign{ki)zi, Right: cumulative distribution function of the 

3(t A^j 1 



Odd Values ofk-ln this case the fields generated in the 
merging of k branches are concentrated over odd values 
of the integers. In particular they cannot be equal to 
zero and the term tanh/3/ii will be always equal to ±1. 
This has deep consequences on the reweighing term, eq. 

and leads to the divergence of the ^'fields. For fc's 
different from zero eq. Q can be rewritten as the sum 
over i terms of the form: 



AX, 



(sign(ft.o)( 



1 - 2e 



-2f3\ho\ 



) - sign( J,)sign(/i,) x 



X (1 - 2e-2''l'''l - 2e' 



■2P\hi\ 



du 



dhi 



sign(Ji)zi (18) 



This term is zero if Zi = 0, while if ^ it can be 
finite, null or equal to — oo, thus leading to a vanishing 
weight. In order to analyze these possibilities it is useful 
to distinguish two cases. In the first case we have: 



sign ( ft-o) sign (J^) sign (/li) = -1 



(19) 



Then the first factor in H18|l is finite and equal to 
--2sign( Ji)sign(ft,i) therefore 



AX^ = -2sign(/i,) 



du 



dhi 



(20) 



Now we make the crucial hypotheses that Zi either is 
zero (with finite probability) or infinite (more precisely 



O(e^^l'^l)) and in this case it has the same sign as hi. 
These hypotheses are motivated by the behavior of the 
various quantities at finite low temperature observed nu- 
merically. At the end we will check that these hypotheses 
are self-consistent. From eq. (|15ll we find that: 



AX, 



Q(g-2/3(|/i.|-|J.|-l)^ 
Q(g-2/3(|h.|-|J.hl)^ 



— cxo for \ki\ = 1, z ^ 
for \ki\ >l,z^O 



The last equation follows from the fact that the smaller 
value of j/cil > 1 is |fci| = 3 because of the odd value of 
k. In the second case we have: 

sign(ft.o)sign(J,)sign(/ij) = 1 

Then the first factor in (|18|l is infinitesimal and AXi is 
given by: 



AX, = 2 (e-2^l^'l - e- 



■2P\ho\ 



-2p\hi\ 



du 



dhi 



s\giv{h.i)zi 
(21) 

We note that the first term is order e ^'^l-^'l therefore 
AX, = Cl(e-2/3(l''d-i)) ^0 for z 7^ 0, \h\ > 1 

Finally we consider the case \ki\ — 1. This is the only 
case in which we have a finite reweighing. To rewrite eq. 
(|21|l we note that the sign of hi is simply given by the 
sign of ki thus we have: 



-2l3\hi\ 



g-2/3|fc.|g-2sign(fci)ei 



\hi\ = |fci|-fTsign(fc,)e,, =4> e 
The same result applies also to ho thus we have: 
du 



AXi 



-2sign(/ci)ei 
-2sign(fco)eo 



dhi 



sign(/i,)z,e 



-2P\Ji\ 



for \ki\ = 1, |fco| > 1 



The presence of the term ©(e"^^'"^"') fixes the scales of 
the non-zero values of z to ©(e^^'"^'') in agreement with 
our hypotheses. Therefore we must rescale z to work 
directly in T — s- limit. The condition sign{hiZi) > is 
self-consistent under iteration, indeed it can be checked 
that the reweighing AX^ gives zero weight to the triplet 
{kQ,eQ,zo} unless each contribution dui/dhiZi to zq has 
the same sign as ho- In order to compute the complexity 
we must consider also the merging of fc-|- 1 branches. The 
main difference is that in this case fco can be equal to zero. 
First of all we note that if feg 7^ the computation of the 
anomalous shift AX is the same as above. The quantity 
AXi in the case that fco = can be rewritten as the sum 
over i of the following terms in the low temperature limit: 



AXi = (tanheo - sign(Ji)sign(/ii)) 
du 



du 



dhi 



sign{Ji)zi 



dhi 



aign{hi)zi{l - sign{Jihi) tanheg) (22) 
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since | tanh eg I < 1 the last factor is always positive and 

AX, = -oo for Zi^O,ko = Q (23) 

The same result applies when considering the quantities 
which enter the variational expression of the complexity 
[Tij l and of the average free energy. We have determined 
the distribution of the fields at u = for odd k by evolv- 
ing numerically populations of triplets {fci, e^, z^}, where 
Zi has been rescaled as Zie~'^^^'^^ — > Zi in order to be fi- 
nite, see fig. (01. As expected there is a finite probability 
of having Zi = 0. We stress that the complicated be- 
havior of the odd-fc model is determined by the fact that 
ki is always different from zero, therefore more generic 
situation {e.g. fluctuating connectivity) should display a 
simpler behavior, like the one of the even-fc model. 
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FIG. 2: T limit annealed theory for Bimodal Distribu- 
tion, k=3. Left: cumulative distribution function of sign(fci)2i 
with rescaled Zi; Right: cumulative distribution function of 
the ei at fci = 1 



In ,I6| it was found that in the Bethe lattice spin-glass 
the total complexity (which is obtained setting u = 0) is 
given by the SUSY-breaking theory i.e. z ^ 0. We have 
checked that this property remains true in the T — > 
limit in the three models considered. We also stress that 
if we force Zj = the population dynamics algorithms of 
the bimodal case do not converge and in particular the 
Ei's diverge implying that the decomposition hi — ki+Tei 
breaks down leading to a distribution which is no more 
concentrated over the integers. The numerical compu- 
tation of the complexity requires higher computational 
efforts and is currently underway. 

Our results raise an interesting question. In the bi- 
modal case the "strong" variables ki obey the recursive 



equations eq. (|f f () that do not depend on the 's and the 
Zi's. We call the solutions {fcf } of these equations "strong 
belief-propagation solutions" (SBPS). Instead the com- 
plexity we are computing yields the number of solutions 
{kf,ef,zf} of equations (|f f If 211 3|l . wc call them full 
belief-propagation solutions (FBPS). In the standard the- 
ory with Zi = the X shift is zero and the complexity 
depends only on the strong variables, thus we obtain for 
the FBPS complexity the same result we would obtain for 
the complexity of the SBPS. Instead the fact that when 
Zi ^ the complexity depends not only on the ki but 
also on the and Zi leads to the possibility that there is 
no biunivocal correspondence between FBPS and SBPS. 
This could happens either because for each SBPS there 
are many FBPS or because there is no FBPS correspond- 
ing to a given SBPS. 

However it is interesting to notice that the question 
can be formulated as a percolation problem. Starting 
from a given SBPS, {kf}, we want to determine a FBPS 
{efjZi} which solves equations Ijf fll2lf3|) . We can pro- 
ceed in the following way, we consider a root site and 
we start exploring all the trees starting from it. On each 
spin i we measure the field ki that it passes in the di- 
rection of the root. If |fc,i| < f we go to the next level 
of the tree while if |fci| > I we stops because from eqs. 
(|I4|I and (|I5|I we knows that it will pass zero messages 
g{ki, ei) = and dui/dhiZi = 0. If at a certain point we 
stop completely, we are left with a tree with vanishing 
messages passed by the leaves, thus we can compute the 
unique value (eo, zo = 0) in a sweep. If we can repeat the 
process for each point of the lattice we find that there 
is a unique FBPS corresponding to the given SBPS and 
that it has Zi = OVz. Thus we can find non vanishing 
z-fields only if we have percolation in this process, cor- 
respondingly we cannot determine uniquely eo and the 
biunivocal correspondence between SBPS and FBPS be- 
comes uncertain. 
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